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^ ' Abstract 

In this paper, we consider a leader-following consensus problem of a group of 
autonomous agents with time- varying coupling delays. Two different cases of cou- 
pling topologies are investigated. At first, a necessary and sufficient condition is 
proved in the case when the interconnection topology is fixed and directed. Then a 
sufficient condition is proposed in the case when the coupling topology is switched 



iy) ■ and balanced. Numerical examples are also given to illustrate our results. 
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1 Introduction 

Recent years have witnessed steadily increasing recognition and attention of coordinated 
motion of mobile agents across a broad range of disciplines. Applications can be found in 
many areas such as biology or ecology (e.g., aggregation behavior of animals in [HO [3]), 
physics (e.g., collective motion of particles in [HE]), and engineering (e.g., formation 
control of robots in [TJ [151 El EI])- The studies of multiple autonomous agents focus on 
understanding the general mechanisms and interconnection rules of cooperative phenom- 
ena as well as their potential applications in various engineering problems. 
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In a multi-agent system, agents are usually coupled and interconnected with some 
simple rules including nearest neighbor rules [H [TO]. A computer graphics model to 
simulate collective behavior of multiple agents was presented in [12]. With a proposed 
simple model and neighbor-based rules, flocking and schooling were successfully simulated 
and analyzed for self-propelled particles in [4J. Also, self-organized aggregation behav- 
ior of particle groups with leaders becomes more and more interesting. The coordinated 
motion of a group of motile particles with a leader has been analyzed in [6] , while leader- 
follower networks have been also considered in [16]. Recently, to design distributed flock- 
ing algorithms, Olfati-Saber has introduced a theoretical framework including a virtual 
leader /follower architecture, which is different from conventional leader /follower architec- 
ture (pi]). 

Sometimes, the coupling delays between agents have to be taken into consideration 
in practical problems ([SJ [9j [10]). For example, [8 J proposed a stability criterion for 
a network of specific oscillators with time-delayed coupling. In [10], the authors studied 
consensus problems of continuous-time agents with interconnection communication delays. 
The dynamics of each agent is first order and the graph to describe the interconnection 
topology of these agents is undirected. 

In this paper, a leader-following consensus problem for multiple agents with coupling 
time delays is discussed. Here the considered dynamics of each agent is second order, cou- 
pling time delay is time- varying, and the interconnection graph of the agents is directed. 
The convergence analysis of the consensus problem with directed graphs (or digraph for 
short) is more challenging than that of undirected graphs due to the complexity of di- 
rected graphs. The analysis becomes harder if time delay is involved. For time-delay 
systems, modeled by delayed differential equations, an effective way to deal with con- 
vergence and stability problems is Lyapunov-based; Lyapunov-Krasovskii functional or 
Lyapunov-Razumikhin functions are often used in the analysis |19j . 

The paper is organized as follows. Section 2 presents the multi-agent model and some 
preliminaries. Then, two cases, fixed coupling topology and switched coupling topology, 
are considered. The leader-following convergence of two models in the two cases are ana- 
lyzed in Section 3 and Section 4, respectively. Here, Lyapunov-Razumikhin functions are 
employed, along with the analysis of linear matrix inequalities. Finally, some concluding 
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remarks are given in Section 5. 

By convention, R and Z + represent the real number set and the positive integer set, 
respectively; I n is an n x n identity matrix; for any vector x, x T denotes is its transpose; 
1 1 ■ 1 1 denotes Euclidean norm. 



2 Model Description 

We consider a group of n + 1 identical agents, in which an agent indexed by is assigned 
as the "leader" and the other agents indexed by 1, n are referred to as "follower- agents" 
(or "agents" when no confusion arises). The motion of the leader is independent and the 
motion of each follower is influenced by the leader and the other followers. A continuous- 
time model of the n agents is described as follows: 



X{ tAj, % 1, 7Z, 



(2) 



or equivalently, 

Vi = Ui 

where the state Xi G R m can be the position vector of agent i, Vi 6 R m its velocity vector 
and Ui G R m its coupling inputs for i — 1, ...,n. Denote 

( x \\ ( v i\ ( u \\ 



x 



X2 



V 2 



U 



U. 2 



e R r ' 



\X n / \V n J \UnJ 

Without loss of generality, in the study of leader-following stability, we take m = 1 
for simplicity in the sequel. Then ([2]) can be rewritten as 



x = v, 

v = ueR n . 

The dynamics of the leader is described as follows: 



(3) 



x = v Q e R, 



(4) 
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where vq is the desired constant velocity. 

If each agent is regarded as a node, then their coupling topology is conveniently de- 
scribed by a simple graph (basic concepts and notations of graph theory can be found in 
[TBI \T7\ [TO]). Let Q = (V,£,A) be a weighted digraph of order n with the set of nodes 
V = {1, 2, n}, set of arcs £ C V x V, and a weighted adjacency matrix A = [a^] G R nxn 
with nonnegative elements. The node indexes belong to a finite index set X = {1, 2, n}. 
An arc of Q is denoted by which starts from i and ends on j. The element o^- associ- 
ated with the arc of the digraph is positive, i.e. > (i, j) G £. Moreover, we assume 
Oii = for all % G X. The set of neighbors of node z is denoted by M% = {j G V : («, j) G £}. 
A cluster is any subset J C V of the nodes of the digraph. The set of neighbors of a 
cluster J is defined by Afj = {J ie jAfi = {j G V : i G J,{i,j) G £}. A pai/i in 
a digraph is a sequence z ,«i,--- , i/ of distinct nodes such that is an arc for 

j = 1, 2, •••,/, / G Z + . If there exists a path from node i to node j, we say that j 
is reachable from i. A digraph Q is strongly connected if there exists a path between 
any two distinct nodes. A strong component of a digraph is an induced subgraph that is 
maximal, subject to being strongly connected. Moreover, if °*i = SjeA/i a i i ^ or a ^ 

i — 1, ...,n, then the digraph is called balanced, which was first introduced in [10J. 

A diagonal matrix D = diag{d\, d n } G R nxn is a degree matrix of Q, whose diagonal 
elements di = X]jeAT a *i ^ or * = ^> n - Then the Laplacian of the weighted digraph is 
defined as 

L = D-AeR nxn . (5) 

To study a leader-following problem, we also concern another graph Q associated 
with the system consisting of n agents and one leader (labelled 0). Similarly, we define 
a diagonal matrix B G R nxn to be a leader adjacency matrix associated with Q with 
diagonal elements bi (i G X), where bi = a i0 for some constant a i0 > if node (i.e., the 
leader) is a neighbor of node i and 6^ = otherwise. For Q, if there is a path in Q from 
every node % in Q to node 0, we say that node is globally reachable in Q, which is much 
weaker than strong connectedness. 

Example 1. As shown in Figs. 1 and 2, both Q\ and Q2 are not strongly connected, 
but they have a globally reachable node 0. Suppose that the weight of each arc is 1 in 
both cases. Obviously, Q 2 with V = {1,2,3,4} is balanced. 
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Laplacians of Q\ and Q 2 as well as the leader adjacency matrices B\, B 2 are easily 
obtained as follows: 



I 1 -1 \ 
-110 

\ -1-12/ 



,^2 



I 1 -1 \ 
-110 
1-1 
\ 0-11/ 



,Bi = B 2 



( 1 \ 



10 

\ / 



Fig.l Qi and £1 



Fig. 2 Q 2 and £ 2 



The following lemma was obtained in (0 Ej). 

Lemma 1 A digraph Q = (V, £, A) has a globally reachable node if and only if for every 
pair of nonempty, disjoint subsets Vi, V2 C V satisfies U-^Sj 7^ 0- 

Remark 1 Let Si, S 2 , S p be the strong components of Q = (V,S) and Ms t be the 
neighbor sets for Si,i = l,...,p,p > 1. From LemmaUl a digraph Q has a globally 
reachable node if and only if every pair of Si, Sj satisfies U-^Sj 7^ V ^ e 9 ra ph is 
strongly connected, then each node is globally reachable from every other node. 

The next lemma shows an important property of Laplacian L ([7]). 

Lemma 2 The digraph Q has a globally reachable node if and only if Laplacian L of Q 
has a simple zero eigenvalue (with eigenvector 1 = (1, 1) T e R n ). 

Due to the coupling delays, each agent cannot instantly get the information from 
others or the leader. Thus, for agent i {i = l,...,n), a neighbor-based coupling rule can 
be expressed as follows: 



a 



(t) = 2j a ij (x j (t-r)-x i (t-r))+b i (a)(x (t-r)-x i (t-r))+k(v -v i (t)), k > 0, (6) 
j'eA/i((T) 



where the time- varying delay r(t) > is a continuously differentiable function with 



< r < r. 



(7) 



a : [0, oo) — » X r = {l,...,iV} (iV denotes the total number of all possible digraphs) is 
a switching signal that determines the coupling topology. The set T = {Q\, ...,Qn} is a 
finite collection of graphs with a common node set V. If a is a constant function, then 
the corresponding interconnection topology is fixed. In addition, Afi(a) is the index set 
of neighbors of agent i in the digraph Q a while = 1, ...,n) are elements of the 

adjacency matrix of Q a and bi(a) (i = l,...,n) are the diagonal elements of the leader 
adjacency matrix associated with Q a . 

With ([6]), (j2J) can be written in a matrix form: 



where L a is Laplacian of Q a and B a is the leader adjacency matrix associated with Q a . 

In the sequel, we will demonstrate the convergence of the dynamics system (jHJ); that 
is, Xi — > xo, Vi — > vo as t — > oo. 

3 Fixed Coupling Topology 

In this section, we will focus on the convergence analysis of a group of dynamic agents 
with fixed interconnection topology. In this case, the subscript a can be dropped. 

Let x = x— XqI, v = v—VqI. Because — (L+B)x(t— r) + Blxo(t— r) = —(L+B)x(t—r) 
(invoking Lemma [2]), we can rewrite system (JSJ) as 




(L a + B a )x(t - r) - k(v - v l) + B a lx (t - r) 




e = Ce{t) + Ee(t - r) 



(9) 



where 



e = 




—hi. 







I, 



■n 



n 




H 



L + B. 
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Before the discussion, we introduce some basic concepts or results for time-delay sys- 
tems ([19j). Consider the following system: 

x = f(x t ), t > 0, 

K ' (10) 

x(e) = <p(6), ee[-T,o), 

where x t (9) = x(t+9),V9 G [-r, 0] and /(0) = 0. Let C([-r, 0], fT) be a Banach space of 
continuous functions defined on an interval [— t, 0] , taking values in R n with the topology 

of uniform convergence, and with a norm \\<p\\ c = max ||</?(#)||. The following result is 

0e[-T,o] 

for the stability of system (|T0"|) (the details can be found in [19]). 

Lemma 3 (Lyapunov-Razumikhin Theorem) Let (pi,4>2, and 4>% be continuous, nonneg- 
ative, nondecreasing functions with <j>i(s) > O,0 2 (s) > O,0 3 (s) > for s > and 
0i(O) = 02(0) = 0. For system ( TTTJj) . suppose that the function f : C([—r,0],R n ) — > R 
takes bounded sets of C([— r, 0], R n ) in bounded sets of R n . If there is a continuous func- 
tion V(t, x) such that 

MM) < V(t,x) < MM), teR, xe R n . (11) 

In addition, there exists a continuous nondecreasing function <f)(s) with 0(s) > s, s > 
such that 

v(t,x)\ m < -MM), *f v{t + e,x{t + e))<cf)(v{t,x{t))), ee[-r,o], (12) 

then the solution x = is uniformly asymptotically stable. 

Usually, V(t, x) is called Lyapunov-Razumikhin function if it satisfies ffTTj) and fTl2|) in 
Lemma [3j 

Remark 2 Lyapunov-Razumikhin theorem indicates that it is unnecessary to require that 
V(t,x) be non-positive for all initial data in order to have stability of system / TTTJj) . In 
fact, one only needs to consider the initial data if a trajectory of equation (TTTJJ) starting 
from these initial data is "diverging" (that is, V(t + 6,x(t + 9)) < <p(V(t, x(t))) for all 
9 G [-r,0] in (CD;. 
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A matrix A is said to have property SC ([18]) if, for every pair of distinct integers H, £ 
with 1 < h, £ < n, there is a sequence of distinct integers h — i%, ij-i, ij = £, 1 < j < 
n such that all of the matrix entries a^, a^^. are nonzero. In fact, it is obvious 
that, if Q is strongly connected, then its adjacency matrix A has property SC. Moreover, 
a matrix is called a positive stable matrix if its eigenvalues have positive real-parts. Note 
that H = L + B plays a key role in the convergence analysis of system (J9]) . The following 
lemma shows a relationship between H and the connectedness of graph Q (as defined in 
Section 2). 

Lemma 4 The matrix H = L + B is positive stable if and only if node is globally 
reachable in Q . 

Proof: (Sufficiency) Based on Gersgorin disk theorem ([IE]), all the eigenvalues of H 
are located in the union of n discs: 

n 

Ger{H) = [j{z e R 2 : \z - d { - h\ < J2 a »}- 

i=l j^i 

However, for the graph Q, di = J2j^i a ij- Thus, every disc with radius di will be located 
in the right half of the complex plane, and then H has either zero eigenvalue or eigenvalue 
with positive real-part. Since node is globally reachable, there exists at least one bi > 0. 
Therefore, at least one Gersgorin circle does not pass through the origin. 
The following two cases are considered to prove the sufficient condition: 

Case (i) Q has a globally reachable node: Let S±, S p (p G Z + ) be the strong components 
of Q. If p = 1, Q is strongly connected. Then its adjacency matrix A has property 
SC. Since D + B is a diagonal matrix with nonnegative diagonal entries, H still 
has property SC. By Better theorem (|18j), if zero is an eigenvalue of H, it is just a 
boundary point of Ger(H). Therefore, every Gersgorin circle passes through zero, 
which leads to a contradiction. Hence, zero is not an eigenvalue of H. 

Up > 1, then there is one strong component, say Si, having no neighbor set by 
Lemma [H We rearrange the indices of n agents such that the Laplacian of Q is 
taken in the form 




where Ln G R tiXK (k < n) is Laplacian of the component S\. From Lemma [21 
zero is a simple eigenvalue of Ln and L, while L22 is nonsingular. Since node is 
globally reachable, then the block matrix B\ 7^ with B = diag{Bx, L? 2 }. Similar 
to the case when p = 1, we conclude that zero is not an eigenvalue of Ln + B±, and 
is also not an eigenvalue of H. 

Case (ii) Q has no globally reachable node: Let Si, S p be the strong components with 
= ®,i = 1)- -)P)P > 1 by Lemma [H Since Ui=i "^0%) c "^(^j Laplacian 
associated with £ can be transformed to the following form: 

/ Ln \ 

(14) 

where Ljj is the Laplacian associated with Si for i = 1, ...,p. One can easily verify 
that L p+ i iP+ i is nonsingular. Since node is globally reachable, then Bi 7^ for 
i = 1, ...,p where Sj, corresponding to Ljj, are diagonal blocks of B. Similar to the 
proof in Case (i), we can obtain that zero is not eigenvalue of Hi or H. 

(Necessity) If node is not globally reachable in Q, then we also have: 

Case (i) Q has a globally reachable node: As discussed before, assume Si has no neighbor 
set, and then we have (fl3l) . where Ln e /^ KXK (k G Z + ) is the Laplacian of Si. 
Invoking Lemma [2, zero is a simple eigenvalue of Ln and L, while L22 is nonsingular. 
By the assumption that node is not globally reachable in Q, then the block matrix 
Bi — with L? = diag{Bi, B 2 }. Therefore, zero is a simple eigenvalue of Ln + Bi, 
and is also a simple eigenvalue of H. This leads to a contradiction. 

Case (ii) Q has no globally reachable node: As discussed before, we have (1141) . By the 
assumption that node is not globally reachable in Q, then there exists at least 
one Bi = for i = 1, ...,p where Bi, corresponding to La, are diagonal blocks of B. 
Thus, Hi and H have more than one zero eigenvalues. This implies a contradiction. 
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Therefore, if node is globally reachable in Q, H is positive stable, and from Lyapunov 
theorem, there exists a positive definite matrix P G /£ nxn such that 

PH + H T P = I n . (15) 

Let p, = maxjeigenvalues of PHH T P} and let A be the smallest eigenvalue of P. Now 
we give the main result as follows. 



Theorem 1 For system take 



k> k* = + (16) 
2A 



(k>l) 



Then, when r is sufficiently small, 

lim e(t) = 0, (17) 

if and only if node is globally reachable in Q . 

Proof: (Sufficiency) Since node is globally reachable in Q, H is positive stable and 
P is a positive definite matrix satisfying (1151) . Take a Lyapunov- Razumikhin function 
V(e) = e T Pe, where 

( kP P 
\ P P 

is positive definite. 

Then we consider ^(e^jgj. 
By Leibniz- Newton formula, 

e(t - r) = e(t) - I e(t + s)ds 

J —r 

e(t + s)ds-E / e(t + s)ds. 

-r J~2r 

Thus, from E 2 = 0, the delayed differential equation ([9]) can be rewritten as 

e = Fe-EC I e(t + s)ds, 

J —r 

where F = C + E. 
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Note that 2a T b < a T ^a + b T ^> 1 b holds for any appropriate positive definite matrix 
\I>. Then, with a = -C T E T Pe, b = e(t + s) and * = P^ 1 , we have 

r° 

V|jgj = e T {F T P + PF)e - 2e T PEC / e(t + 

— r 

<e T (F T P + PF)e + re T PECP- 1 C T E T Pe+ / e T (t + s)Pe(t + s)ds. 
Take 0(s) = gs for some constant g > 1. In the case of 

V(e(t + 6)) <qV(e(t)), -r <6<0, (18) 



we have 



where 



V < -e T Qe + re T (PECP- 1 C T E T P + qP)e, 



g = -(F J P + PF) 



In H T P 
PH 2(fc-l)P 

Q is positive definite if k satisfies ffl6l) . according to Lemma H] and Schur complements 
theorem ([IS])- Let \ min denote the minimum eigenvalues of Q. If we take 

r \\PECP- l C T E T P\\ + q\\P\y { ' 

then V"(e) < — r?e T e for some r/ > 0. Therefore, the conclusion follows by Lemma El 

(Necessity) Since system ([9]) is asymptotically stable, the eigenvalues of F have nega- 
tive real-parts, which implies that H is positive stable. By Lemma HI node is globally 
reachable in Q. I 

Remark 3 In the proof of Theorem^, we have obtained a finite bound of the considered 
time-varying delay, that is, r in (T7^). though "t is sufficiently small" is mentioned in 
Theorem [IJ 



Remark 4 Obviously, (fT7y still holds if the time delay is constant. Moreover, if the 
system (TJ|) is free of time-delay (that is, r = 0), then the coupling rule (0|) becomes 

u i{t) = ^2 ^(^'(O ~~ Xi ^)) + h{o-){x {t) - Xi{t)) + k(v - Vi(t)), 

3'6M(ff) 



which is consistent with the nearest neighbor rules in lW\ 
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For illustration, we give an numerical example with the interconnection graph given 
in Fig. 1. It is not hard to obtain 



p, = 0.3139, A = 0.1835, k* = 2.7106, 



\ min = 0.3325, q = 1.0500, r = 0.0334, 

/ 0.5379 0.5758 0.0439 0.0227 \ 
0.5758 1.1667 0.1091 0.0909 
0.0439 0.1091 0.5833 0.0833 
0.0227 0.0909 0.0833 0.2500 
Take k = 3 and the time- varying delay r(t) = 0.0300| cos(t)| in the simulation. 

Fig. 3 shows the simulation results for both position errors and velocity errors, while 
Fig. 4 demonstrates that the trajectories of the four agents and the one of the leader. 



V 



/ 





Fig. 3. Leader-following errors of four agents with the coupling topology shown in Fig.l 




Fig. 4. Trajectories of four agents and the leader with the coupling topology shown in Fig.l 
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4 Switched Coupling Topology 

Consider system flS]) with switched coupling topology. Still taking x = x — x l,v = v — v l, 
we have 

e=Ce(t)+E a e(t-r). (20) 
where a is the switching signal as defined in Section 2, and 

i o o\ 

E a — I , H a = L a + B a . 

At first, we study the matrix H a = L a + B a . 

Lemma 5 Suppose Q a is balanced. Then H a + Hj is positive definite if and only if node 
is globally reachable in Q . 

Proof: (Necessity) The proof is quite trivial and omitted here. 

(Sufficiency) Because Q a is balanced, it is strongly connected if it has a globally reach- 
able node. Then from Theorem 7 in [10], ^(L a +L^) is a valid Laplacian matrix with single 
zero eigenvalue. After some manipulations, it is not difficult to obtain that ^(L a +L^)+B a 
is positive definite (the details can be found in [15]) and so is H a + H J. 

If Q a has no globally reachable node, then there is no arc between every pair of distinct 
strong components and we can renumber the nodes so that Laplacian associated with Q a 
has the form 

£22 (cr) 



( LnW \ 



(21) 



V l pp(°~) J 

where each La(a) is Laplacian associated with a strong component Si for i = 1, ...,p,p > 1. 
By the assumption that node is globally reachable in Q a , then each diagonal block matrix 
Bi(a), corresponding to La(a), is nonzero. Then, it is easy to see that j(Ln(a)+Ln(a T )) + 
Bi(a) is positive definite and therefore, H a + ifj is positive definite. I 
Based on the balanced graph Q a (with Lemma [5]) and the fact that the set Xr is finite, 
both A = min{ eigenvalues of H a + Hj} > and \i = max{eigenvalues of H a Hj} > can 
be well defined. 
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Theorem 2 For system $2ffl with balanced graph Q a , take 



k > k* = + 1. (22) 



2X 

If node is globally reachable in Q a and r is sufficiently small, then 

lim e(t) = 0. 

Proof: Take a Lyapunov-Razumikhin function V(e) = e T $e, where 



kT T 



s = i - - i ( fc >i; 

is positive definite. 

Similar to the analysis in the proof of Theorem (TJ we can obtain 

r° 

V< e T (Fj<5> + <5>F a )e + re T <5>E a C a $- 1 CjEj<5>e+ / e T {t + s)$e(t + s)ds. 

J —r 

Take <f>(s) = qs for some constant q > 1. In the case of 

V(e(t + 6)) <qV(e(t)), -r<9<0, (23) 



we have 



where 



V < -e T Q a e + re^Ka^Cj^ + g $) £) 



Q CT = -(Fj$ + $F (T ) 



2(fc - 1)4 



Q CT is positive definite for any value of cr and then V"(e) is negative definite if we take (1221 
and 

r < r = Xmin (24) 

^+1^ + 1 + ^-1)2 + 4)' 

where A m j„ denotes the minimum eigenvalue of all possible Q a . Thus, the conclusion is 

obtained according to Lemma [H I 

In the switching case, the assumption of balanced graph Q a is not necessary for the 

stability result in Theorem [2J The following numerical example shows that the stability 

can be obtained even if the coupling topology graph is not balanced sometimes. 



14 



Here we consider there are two coupling topologies, given in Figs. 1 and 2, switching 
between each other, with the following switching order: {^1,^2,^1,^2, •••}• With simple 
calculations, we have 

A = 0.5028, Ji, = 7.9257, k* = 7.8816, 

X min = 0.4781, q = 1.0500, r = 0.0174. 

Take k = 9 and the time- varying delay r(t) = 0.0150| cos(£)|. Then the simulation results 
are shown in Fig. 5. 




Fig. 5. Leader-following errors with two switching graphs given in Fig.l and Fig. 2 

5 Conclusions 

This paper addressed a coordination problem of a multi-agent system with a leader. A 
leader moves at the constant velocity and the follower- agents follow it though there are 
time-varying coupling delays. When the coupling topology was fixed and directed, a nec- 
essary and sufficient condition was given. When the coupling topology was switched and 
balanced, a sufficient condition was presented. Moreover, several numerical simulations 
were shown to verify the theoretical analysis. 
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